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DESCRIPTION 

Natural Language Processing Apparatus and Natural Language Processing Method 
Technical Field 

This invention relates to a natural language processing apparatus and a natural 
language processing method for processing natural language, and more particularly to 
a natural language processing apparatus and a natural language processing method 
which simplify selection/confirmation by user in the process of processing. 
Background Art 

Hitherto, various systems utilizing natural language processing such as 
automatic translation, voice recognition, document retrieval and document processing, 
etc. have been put into practical use. 

There is shown in FIG. 1 flowchart of outline of processing procedure of a 
voice translation apparatus according to the prior art as an example of the conventional 
system. 

In the processing procedure of this voice translation apparatus, voice input of 
step SlOl is caused to undergo voice recognition at step S102. Result of that voice 
recognition is confirmed by user at step S103 . When result of voice recognition is 
recognized by user, recognition result is subjected to machine translation at step S 1 04. 
If otherwise, processing returns to the step SlOl to execute voice recognition for a 
second thne. 

Result of machine translation of the step SI 04 is caused to undergo 



confkmation by user at step S 1 05 . If necessary, editing is implemented thereto at step 
S 106. Synthetic voice (speech) is generated at the last step 107. Thus, this processing 
procedure is completed. 

At stated above, at step SlOl, user first inputs, to a voice translation unit, 
conversation that he intends by voice. The voice translation unit carries out 
recognition of voice inputted at step SI 02 to display its result. Since erroneous 
recognition could take place in the voice recognition processing, a processing such that 
user confirms recognition result is frequently carried out. 

As a method of confirming recognition result at step S103, there have been 
frequently used a method of displaying plizral higher rank candidates which have 
indicated high score in the recognition processing to allow user to select desired one 
among them, and the like. In the case where sentence that user himself has said is not 
included in the sentences displayed, sound input is carried out for a second time. 
When the sentence that user has carried out voice input is decided or established by 
confirmation of user, that sentence is translated into objective language in tim at step 
SI 04, 

Since there is the possibility that result including error may be outputted also 
in the translation processing, there is carried out such a work that user confirms 
translation result at step S105 for the purpose of maintaining translation accuracy. 
Further, in the case where translation result is not suitable, editing into representation 
of suitable objective language is carried out at step SI 06. 



In addition, synthetic voice is generated from translation result and is outputted 
at step S106. Thus, processing procedure of this voice recognition is completed. 

However, in conventional systems utilizing natural language processing, it 
cannot be said that interface suitable for user is prepared or arranged. For example, 
in the case of the voice translation unit thus constituted, there are two problems as 
described below. 

First problem is variety of natural languages to be handled and processing 
accuracy. In the present machine translation, it is very difficult to translate various 
input sentences with high accuracy, In general, in the machine translation, there exists 
the problem that according as various sentence styles are handled as input sentences 
of original or source language, accuracy of translation is lowered to more degree. On 
the other hand, while restriction is given to sentence style or vocabulary of input 
sentence, etc., thereby making it possible to improve accuracy of translation, 
compelling of such input with restriction becomes burden on user. In addition, in the 
case where there exist polysemy such as meaning or relationship of modification or 
circmnstance dependency, etc. in the input sentence, there generally exist plural results 
that such input sentence is translated. 

In order to univocally specify this, there may be employed either an approach 
to automatically select suitable candidate on the translation unit side, or an approach 
to select that candidate by user. However, the fomier has the problem that erroneous 
candidate may be selected, and the latter has the problem that it is difficult to select 



that candidate if user is not familiar with the objective language. In this case, as 
application of the latter, there may be employed a method of translatiag translation 
result into original language for a second time to present that re-translation result to 
user to thereby allow him to cany out selection/confirmation. However, there may 
take place error in the process of re-translation. In addition, in place of presenting 
translation result, in a method of presenting internal representation of sentence 
structure tree, etc. or log of process of translation processing, etc., user must know way 
of finding. Accordingly, selection/confirmation by user is difficult. 

The problem applies not only to machine translation processing, but also to all 
apparatuses utilizing natural language processing such as data base retrieval and/or 
representation support, etc. by natural language. 

The second problem is confinnation work of user. When the processing 
procedure is viewed from viewpoints of confirmation work of user, user is required to 
twice cany out confinnation works of result of voice recognition and result of machine 
translation. Thus, the number of confinnation operations is large. Such a work is 
troublesome. 

This generally applies to systems in which plural modules utilizing natural 
language processing are combined. For example, let now consider the case where an 
approach is employed to input Japanese by using kana-kanji conversion to translate it 
into English by using machine translation. User inputs Japanese sentence by kana to 
confinn converted Chinese character (kanji) to first generate correct Japanese sentence 
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in which correct kanas and kanjis are mixed. Then, Japanese- English translation is 
carried out with that Japanese sentence being as input, and user confirms that result 
for a second time. 

In addition, in the case of machine translation, there is the problem that when 
user is not familiar with objective language, it is very difficult to confirm translated 
result. 

Disclosure of the Invention 

This invention has been made in view of actual circumstances as described 
above, and its object is to provide such a natural language processing apparatus and 
such a natural language processing method to maintain processing accuracy and to 
reduce confinnation work. 

A natural language processing apparatus according to this invention includes 
input means for inputting natural language, conversion means for converting the 
natural language inputted by the input means, confinnation means for confirming the 
natural language converted by the conversion means, processing means for 
implementing processing to the natural language confinned by the confirmation 
means, and output means for outputting the natural language processed by the 
processing means. 

Moreover, a natural language processing apparatus according to this invention 
includes input means for inputting natural language, one processing means, or two 
processing means or more for implementing processing to the natural language, one 



confirmation means, or two confirmation means or more for confirming result of 
processing with respect to the natural language, and output means for outputting the 
processed natural language, wherein result processed in order of first processing means 
and first confirmation means for confirming its result is used, the natural processing 
apparatus being such that there are provided, at the preceding stage of the first 
processing means, second processing means for converting natural language inputted 
to the input means into such a form to have ability to process it, with high accuracy, 
and second confirmation means for confirming result of the second processing means 
to thereby carry out execution in advance of confirmation to omit confirmation of 
result of the first processing means. 

Further, a natural language processing apparatus according to this invention 
includes input means for inputting natural language, conversion means for converting 
first language inputted to the input means into representation having one-to-one 
correspondence with respect to representation of second language by representation 
by the second language and representation by third language, confirmation means for 
confinning the representation of the third language converted by the conversion 
means, processing means for implementing processing to the natural language inputted 
by the input means in dependency upon result of confirmation at the confirmation 
means, and output means for outputting the natural language processed by the 
processing means. 

A natural language processing method according to this invention includes an 
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input step of inputting natural language, a conversion step of converting the natural 
language inputted at the input step, a confinnation step of confirming the natural 
language converted at the conversion step, a processing step of implementing 
processing to the natural language confirmed at the confirmation step, and an output 
step of outputting language processed at the natural language processing step. 

Moreover, a natural language processing method according to this invention 
includes an input step of inputting natural language, one processing step, or two 
processing steps or more of unplementing processing to the natural language, one 
confirmation step, or two confirmation steps or more of confirming result of 
processing with respect to the natural language, and an output step of outputting the 
natural language thus processed, wherein result processed in order of the first 
processing step and first confirmation step to confirm its result is used, the natural 
language processing method being such that there are provided, at the preceding stage 
of the first processing step, a second processing step of converting the natural language 
inputted at the input step into such a fonn to have ability to process it with good 
accuracy and a second confirmation step of confinning the result of the second 
processing step to thereby carry out execution in advance of confirmation to omit 
confirmation of result of the first processing step. 

Further, a natural language processing method according to this invention 
includes an input step of inputting natural language, a conversion step of converting 
first language inputted at the input step into representation having one-to-one 
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correspondence with respect to representation by second language by representation 
by the second language and representation by third language, a confirmation step of 
confimiing representation of the third language converted at the conversion step, a 
processing step of implementing processing to natural language inputted at the input 
means in accordance with result of confirmation at the confirmation step, and an 
output step of outputting natural language processed at the processing step. 

As stated above, in this invention, without directly applying natural language 
processing to sentence (also including phrase and clause in addition to sentence, which 
applies to the following description) that user has inputted, "representation conversion 
processing" and "confirmation/selection wait (standby)" are added therebetween. 
Alternatively, the above-mentioned natural language processing and representation 
conversion processing are carried out at the same time and confirmation /selection is 
carried out with respect to "pair of natural language processing result and 
representation conversion processing result" thus generated. Namely, there is carried 
out representation conversion processing to convert input sentence into such a 
sentence to have ability to execute subsequent natural language processing with good 
accuracy so as to become close to intention of user. In place of carrying out 
representation conversion processing before machine translation processing, machine 
translation processing may be also carried out at the same time. 

Between "information/ selection wait (standby)" and "machine translation", "re- 
conversion processing" may be added. In this processing, there is only carried out 
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conversion to exchange^ etc. word order of a partial sentence which does not change 
meaning or nuance of sentence within the "representation conversion". Thus, it is 
possible to provide sentence relatively close to input sentence presented to user, and 
to provide sentence suitable for processing with respect to translation processing. 

Further, the representation translation conversion processing may be carried out 
simultaneously with machine translation processing in place of carrying out it before 
machine translation processing. In this case, such an approach is employed to prepare 
corresponding representation conversion processing every translation processing to 
also apply corresponding representation conversion processing when a certain 
translation processing is applied to a certain sentence. When such an approach is 
employed, translation result and representation conversion processing are generated 
as a pair. Further, "confirmation/selection" is carried out by presenting only 
corresponding pair or representation conversion result. 

In addition, this invention classifies processing into processing in which 
accuracy can be guaranteed and processing in which accuracy cannot be guaranteed 
to collectively carry out processing of the portion in which accuracy cannot be 
guaranteed even with respect to processing over plural functional modules thereafter 
to carry out confirmation work of user to thereby lessen (reduce) the number of 
confirmation operations of user. Namely, in the above-mentioned processing 
procedure, without employing a method of canying out machine translation after result 
of voice recognition is established , an approach is employed to carry out machine 
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translation processing while holding plural possibilities as result of voice recognition 
so that user confirms only its result. 
Brief Description of the Drawings 

FIG. 1 is a flowchart of outline of processing procedure of a voice translation 
apparatus (unit) according to the prior art, 

FIG. 2 is a block diagram showing outline of the configuration of the translation 

unit. 

FIG. 3 is a view showing an example of template. 

FIG. 4 is a view showing equivalent or bilingual dictionary. 

FIG. 5 is a view showing an example of representation conversion mle. 

FIG. 6 is a view for explaining conversion result with respect to "Baggu o 
kaitainodesu ga, misete itadakenaide shoka?". 

FIG. 7 is a flowchart showing steps of processing of translation unit. 

FIG. 8 shows steps of processing of the translation lanit and a flowchart with re- 
conversion processing. 

FIG. 9 is a block diagram showing outline of the configuration of voice 
translation vmit. 

FIG. 10 is a perspective view showing appearance of the voice translation xmit. 
FIG. 11 is a flowchart showing steps of processing of the voice translation unit. 
FIG. 12 is a view for explaining an example of processing in the voice 
translation unit. 
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FIG. 13 is a view showing example of equivalent or bilingual template. 
FIG. 14 is a view showing example of input and output. 
FIG. 15 is a view showing example of input and output. 
FIG. 16 is a view showing an example of template to which comment is added. 
FIG. 17 is a view showing an example of output with respect to input 
"suimasen". 

FIG. 18 is a view showing an example of output with respect to input " ^ga,-- 

FIG. 19A is a view showing the state before execution in advance of 
confirmation is applied. 

FIG. 19B is a view showing the state after execution in advance of confirmation 
is applied. 

FIG. 20 A is a view showing the state before postponement of confirmation is 
applied. 

FIG. 20B is a view showing the state after postponement of confirmation is 
applied. 

FIG. 21 A is a view showing the state before execution in advance and 
postponement are applied. 

FIG. 2 IB is a view showing the state after execution in advance is applied. 

FIG. 21C is a view showing the state after execution in advance and 
postponement are apphed. 
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FIG. 22 A is a view showing voice translation. 

FIG. 22B is a view in which execution in advance is applied to FIG. 22 A. 
FIG. 22C is a view in which postponement is apphed to FIG. 22B. 
FIG, 22D is a view in which postponement and merger (integration) are apphed 
to FIG. 22C. 

Best Mode for Carrying Out the Invention 

Preferred examples of the configuration according to this invention will be 
described below with reference to the attached drawings. 

Explanation will be first given in connection with a translation apparatus (unit) 
for carrying out machine translation utilizing natural language processing as a first 
embodiment of this invention. 

The translation unit is composed of, as shown in FIG. 2, a display section 1 for 
displaying result of representation conversion/machine translation, etc., an input 
section 2 for accepting (receiving) input, a representation converting section 3 for 
converting fonn of representation, a machine translation section 4 for carrying out 
conversion into other language, and a control section 5 for controlling respective 
sections of this translation unit. 

The display section 1 is comprised of, e.g., liquid crystal display, etc. and serves 
to display representation conversion/machine translation, etc. on the basis of command 
of the control section. 

The input section 2 is comprised of, e.g. , plural button switches or touch panels, 
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etc. User carries out, by utilizing them, selection from information displayed on the 
display section 1 and/or menu selection with respect to the operation of the system. 
Moreover, the input section 2 also accepts input of sentence to be translated. Thus, 
the input section 2 transmits result of input by user to the control section 5. 

The representation converting section 3 is composed of, e.g., CPU, ROM, 
RAM, etc. The representation converting section 3 receives result of input applied to 
the input section 2 by user through the control section 5, Further, the representation 
conversion section 3 converts result of input received from the control section 5 into 
data of form such that it can be handled at the machine translation section 4. The 
representation converting section 3 transmits the converted result to the control section 
5. 

The machine translation section 4 is composed of, e.g., CPU, ROM, RAM, etc., 
similarly to the representation converting section 3. The machine translation section 
4 receives result of conversion by the representation converting section 3 through the 
control section 5. The machine translation section 4 translates converted result 
received from the control section 5 into other language. Further, the machine 
translation section 4 transmits result translated into other language to the control 
section 5. 

The control section 5 is also composed of, e.g., CPU, ROM, RAM, etc. 
similarly to the representation converting section 3 and the machine translation section 
4. The control section 5 carries out, e.g., such a data transmitting control to transirdt 
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data inputted to the input section 2 to the representation converting section 3 to 
transmit converted result from the representation converting section 3 to the machine 
translation section 4. In addition, the control section 5 carries out control by control 
signals with respect to respective portions of this translation unit. 

It is to be noted that, in addition to the fact that the representation converting 
section 3 , the machine translation section 4 and the control section 5 are independently 
constituted as described above, they may be constituted as functional blocks within the 
control block constituted by the same CPU, ROM, RAM. 

Machine translation utilizing natural language in this translation unit will now 
be described. 

In this translation unit, restrictions with respect to the method of translation, 
original language which is language before translation and objective language which 
is language after translation are not particularly made. However, in the following 
description, as the translation system, there is employed a system in which bilingual 
or equivalent template is used and phrases on the template are exchanged to thereby 
generate translated result. In addition, Japanese is employed as original language and 
English is employed as objective language. 

The bilingual template consists of Japanese portion and portion translated into 
English. In the example of the bilingual template shown in FIG. 3, "X please" 
corresponds to "X (material) o kudasai". "I want to go to X." corresponds to " Watashi 
wa X [place] ni ikitai". "Would you show Y X?" corresponds to "X (material) o Y 
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[person] ni misete kudasai". "SI, but S2" corresponds to "SI [sentence] shikashi S2 
sentence". "SI, andS2." corresponds to SI [sentence] soshite S2 [sentence]". "SL So 
S2." corresponds to "SI [sentence] dakara S2". "Thank you." corresponds to 
"suimasen (= arigato)". "I'm sorry " corresponds to suimasen (^ayamaru)", "Excuse 
me"corresponds to suimasen (yobikake)". "X go by Y. "corresponds to X (person) ga 
Y(vehicle) o tsukau" "X consume Y," corresponds to "X [person] ga Y o tsukau (=X 
ga Y o shohi sum)". 

In the bilingual or equivalent template, the Japanese portion is sentence, phrase, 
clause or, word of the Japanese. It is to be noted that sentence, phrase, clause and 
word will be called sentence for simplicity in the following description. A portion of 
the Japanese portion can be also represented by parameter (variable), and attribute in 
which that parameter (variable) should be satisfied can be also designated. For 
example, in "X(material) o kudasai" of 1 of FIG. 3, X of "X(material)" is parameter 
(variable), and phrase having attribute of "material" can be substituted. Attributes of 
respective phrases are assumed to be described in the bilingual dictionary which will 
be described later. 

The English translated portion of the bilingual template is bihngual or 
equivalent translation of the Japanese portion. In the case where variable is included 
in the Japanese portion, the English portion also includes variable in corresponding 
portion. Since, e.g., "X (material) o kudasai" of the Japanese portion of 1 of FIG. 3 
includes variable, the portion translated into English "X please." also includes variable 
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in corresponding portion. 

In the bilingual or equivalent dictionary, phrase of Japanese, phrase of EngUsh 
corresponding thereto and attribute to be satisfied are described. As an example of the 
equivalent (bilingual) dictionary, as shown in FIG. 4, there is mentioned a dictionary 
such that English "I" and attribute "person" correspond to the Japanese "Watashi", 
English "apple" and attribute "material" correspond to the Japanese "ringo", English 
"London" and attribute "place" correspond to Japanese "London", and English "bag" 
and attribute "material" correspond to Japanese "baggu". 

Processing of representation conversion in the representation converting 
section 3 will now be described.. 

The representation converting section 3 receives, through the control section 5, 
sentence that user has inputted to the input section 2. Further, representation of this 
sentence is converted so that it can be translated with good accuracy. In this 
embodiment, the representation converting portion 3 converts, within Japanese, 
sentence that user has inputted by the Japanese so that the Japanese is matched with 
the Japanese portion of the equivalent (bilingual) template. 

As conversion in the representation converting section 3, in addition to one-to- 
one conversion, m-to-one conversion and 1- to-n conversion, and n-to-m conversion 
in which these conversions are combined are also conceivable. 

In this instance, one-to-one conversion is conversion in which one conversion 
result exists with respect to one input sentence. Moreover, m-to-1 conversion is 
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conversion in which one conversion result exists with respect to m number of input 
sentences. Further, one-to-n conversion is conversion in which n number of 
conversion results exist with respect to one input sentence. 

In addition, as conversion of representation, merger (integration), division, 
insertion, deletion, replacement, exchange of order are conceivable in general 

As stated above, since the representation conversion rule is based on the 
premise that user is caused to carry out selection/confumation after conversion, there 
may be plural candidates after conversion, and such a conversion that nuance is 
changed to some extent may be employed. 

Subsequently, explanation will be given in connection with, as main conversion 
rule, conversion rule for sentence end, rule for dissolving compound sentence, rule for 
polysemous expression, shortage element supplement rule, and order exchange mle. 

In the case where plural expressions exist with respect to one intention, i.e., 
sentence maitily end representations are mainly different, the conversion rule for 
sentence end is the rule for allowing these plural expressions to correspond to single 
expression. 

As the sentence end conversion rule, in the case where, e.g., request (order) is 
given by the Japanese, plural expressions "shite kudasai", "shite moraemasenka" 
,"shite itadakenaideshoka" and "shitehoshinodesuga" are replaced by single expression 
of "shitekudasai". This is the example where replacement is carried out by the above- 
described conversion of m to 1 . 



18 

According to the conversion rule of FIG, 5, as sentence end conversion rule, " 
shitekudasai" corresponds to " - te moraemasenka", " - shite kudasai" corresponds 
to " - te itadakenaide shoka", tai'' corresponds tai no desu", and " - tai" 
corresponds to "'^ tai nodesuga". 

With respect to compound sentence dissolution rule, since there exist 
polysemous sentences in dependency upon conjunction post positional word or 
conjunction, plural alternate portions replaced by univocal conjunction are generated 
in such a case. The compound sentence dissolution rule is the example in which 
division is carried out by the above-described conversion of 1 to n. As polysemous 
compound sentence, e.g., "~ ga, ~" may be affirmative conjunction or negative 
conjunction. 

In accordance with the conversion rule of FIG. 5, as compound sentence 
conversion rule, o shikashi, " correspond to "~ ga (conjtmction post positional 
word)— o , soshite, " corresponds to ga (conjunction post positional word) 
" - dakara o , " corresponds to "-^ ga (conjunction post positional word)--- " o 
dakara - " corresponds to te - " " soshite - " corresponds to " - te ~ and 
c shikashi - " corresponds to "--^ te - 

In the rule for polysemous expression of sentence, polysemous expression 
generates plural candidates replaced by univocal expression. This is the example 
where replacement is carried out by conversion of 1 to n. As polysemous expression, 
e,g., "suimasen" is used when thanks are said, when other person is called, and when 
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apology is made. 

In accordance with the conversion rule of FIG. 5, as rule for polysemous 
expression, "suimasen arigato)" correspond to "suimasen", "suimasen (ayamaru) 
corresponds to "suimasen", "suimasen yobikake)" corresponds to "suimasen", "X 
o tsukau (= X ni noru)" corresponds to "x o tsukau", and "X o tsukau (= X o shohi 
suru)" corresponds to "X o tsukau". 

The shortage element supplementary rule is the rule for supplementing elements 
in the case where such element short when tanslation into English is made is applied 
to input sentence. For example, this mle is a rule such that when "koreo misete 
kudasai" is translated, "watashi ni" is supplemented. Defaults of phrase to be 
supplemented are described in, e.g., bilingual or equivalent template. This is the 
example where insertion is carried out. 

In accordance with the conversion mle of FIG. 5, as shortage element 
supplementary rule, "(kore o) misete kudasai" corresponds to "ixdsete kudasai", "(areo 
o) misete kudasai" corresponds to "misete kudasai", and (sore o) misete kudasai" 
corresponds to "misete kudasai". 

The order exchange mle is the mle for exchanging word order within the range 
where meaning is not changed. For example, in the case where input sentence is "sore 
o watashi ni kudasai" and "X o Y ni kudasai" is described on the template, "sore o" 
and "watashi ni" of input sentence are exchanged to carry out conversion into "watashi 
ni soreo kudasai" so as to have ability to match with the template. This is the example 
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where order exchange is carried out. 

In accordance with the conversion rule of FIG. 5, as the order exchange rule, 
"X ga Y o" corresponds to "Y o X ga'\ "X ga Y ni" corresponds to "Y ni X ga", "X 
ga Y ni Z o" corresponds to X ga Z o Y ni'\ X ga Y ni Z o" corresponds to "Y ni X 
ga Z o", "X ga Y ni Z o" corresponds to "Y ni Z o X ga X ga Y ni Z o corresponds 
to Z o X ga Y ni and "X ga Y ni Z o" corresponds to "Z o Y ni X ga". 

Phrases which do not match with Japanese portion of the biKngual or equivalent 
template even if such conversions are implemented to inputted sentence or phrase are 
caused to undergo best matching by using suitable scale to allow user to make 
selection with respect to candidates of the rank N obtained as the result thereof, or to 
display message to the effect that "this input cannot be handled". 

When representation of sentence inputted at the representation converting 
section 3 is converted, its result is presented to user to carry out 
confirmation/selection. 

Namely, whether or not conversion result of the representation converting 
section 3 is in correspondence with intention of user is confirmed. In the case where 
plural conversion results are generated, these conversion results are presented to allow 
user to select conversion result that he intends. 

As confirmation/selection, there are a method of carrying out such an operation 
every time the above-mentioned conversion rules are applied, a method of carrying out 
such an operation every time all the conversion rules are applied and a method of 
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carrying out such an operation only once every time several conversion rules are 
applied, etc. 

Among the representation conversion rules, there is rule such that meaning of 
the sentence is hardly changed like, e.g., order conversion rule. Such a rule may be 
applied after confirmation/selection by user is carried out to carry out re-conversion. 
Namely, in the case where the meaning of the sentence is hardly changed, re- 
conversion to carry out conversion for a second tiine can be made with respect to 
conversion candidates after confirmation/selection. 

By adding processing of such re-conversion, confirmation/selection can be 
carried out by the same word order as that of input sentence to provide (present) 
sentence suitable for processing in translation processing. 

Subsequently, explanation will be given by taking the example with respect to 
processing of representation conversion carried out at the representation converting 
section 3. 

Conversion process when "baggu o kaitainodesuga, misete itadake naideshoka?" 
is inputted as example of the processing in this case is indicated with reference to FIG. 
6. It is to be noted that while, in this example, it is assiimed that 
confirmation/selection is carried out every time one conversion rule is applied, 
confirmation/selection may be made at other timings. 

First, at step SI, input sentence of "Baggu o kaitainodesga, misete itadake 
naideshoka?" is sent from the control section 5 to the representation converting section 
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3. 

At step S2, the representation conversion section 3 dissolves input sentence into 
two sentences by using the item of ga " for dissolving compound sentence and 
xmivocal conjunction is supplemented. Since conjunction "ga" may be affirmative 
conjunction, negative conjunction, and reason (like conjunction indicating reason), 
three kinds of conjunctions "shikashi", "soshite" and "dakara" maybe supplemented. 

Thus, the input sentence is converted into three kinds of sentences "baggu o 
kaitainodesu. Shikashi misete itadakenaideshoka?" , "baggu o kaitainodesu. Soshite, 
misete itadakenideshokat?" and "baggu o kaitainodesu, Dakara misete 
itadakenaideshoka?". These three kinds of sentences are presented on the display 
section 1. 

From three kinds of sentences presented on the display section 1, the third 
sentence "baggu o kaitai nodesu. dakara, misete itadakenaideshoka?" is assumed to 
be selected. 

At step S3, the representation converting section 3 applies sentence end 
conversion rule to the selected third sentence to carry out conversion so as to obtain 
representation which is simple and is in correspondence with intention of user. By 
application of the sentence end conversion rule, " ~ tai nodesu" is changed into tai", 
and "~ te itadakenaide shoka?" is changed into " - de kudasai". Namely, the third 
sentence is converted into "baggu o kaitaio Dakara misete kudasai." 

At step S4, the representation converting section 3 supplements element short 
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in carrying out translation into English by using shortage element supplementary rule 
with respect to this sentence. By using the conversion rule shown in FIG. 5, "Watashi 
wa" is supplemented with respect to "baggu o kaitai", and "sore o" and "watashi ni" 
are supplemented with respect to "Misete kudasai.. 

At step S5, the representation converting section 3 converts input sentence into 
"(Watashi wa) baggu o kaitai Dakara (sore o) (watashi ni) misete kudasai.". Since this 
sentence is matched with the Japanese portion of the bilingual or equivalent template, 
translation can be made with higher accuracy as compared to the first input sentence. 

In the above-mentioned example, since representation conversion is carried out 
within the original language, user can easily carry out confirmation/selection. 

On the other hand, in the case where translation from Japanese to Geraian is 
assmned , English-German translation has generally accuracy higher than Japanese- 
German translation in automatic translation by machine. Accordingly, in the case 
where user is also familiar with English in addition to Japanese, there can be also 
realized a system configuration to carry out conversion of representation by first 
carrying out translation from the Japanese to the English to allow user to confinn its 
result thereafter to translate it into Gennan. 

Subsequently, processing process (steps) of machine transformation in the 
translation apparatus will be described with reference to the flowchart shown in FIG. 
7. 

At the first step SI 1, input waiting (standby) to wait for input of sentence by 
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user to input section 2 is carried out. When sentence is inputted to the input section 
2, the inputted sentence is transmitted to the representation converting section 3 by the 
control section 5. 

At step S12, the representation converting section 3 converts the inputted 
sentence within original language. At the subsequent step S 13, the sentence converted 
at the step S12 is displayed on the display section 1 to wait for standby input of 
confirmation/selection by user. 

At step S14, translation processing is carried out, at the machine translation 
section 4, with respect to the sentence which has been caused to undergo 
confirmation/selection at the step S13, At the step S 14, translation result is displayed 
on the display section 1. Thus, this processing procedure is completed. 

As stated above, sentence that user has inputted is not caused to directly 
imdergo natural language processing, machine translation processing in the case of the 
above-mentioned example, but "representation conversion processing" and 
"conformation/selection standby " are added therebetween. 

The representation conversion processing converts input sentence into sentence 
close to intention of user, and converts it into sentence which can execute natural 
language processing subsequent thereto with good accuracy. Since this representation 
conversion processing is based on the premise that user is required to carry out 
confirmation/selection after representation conversion, it is sufficient that accuracy of 
conversion is not necessarily high, and plural conversion results are generated. 
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It is to be noted that, in the above-described processing steps, as shown in FIG. 
8, re-conversion processing of step S21 may be carried subsequently of 
confinnation/ selection standby of step S 1 3 subsequent to conversion processing within 
original language of step S12. In this case, since other steps are the same as 
processing procedure shown in FIG. 7, the same reference numerals are respectively 
attached thereto. 

As stated above, "re-conversion processing" may be added between 
"confirmation/ selection standby" and "machine translation". In this processing, there 
is carried out only conversion to, e.g., exchange word order of a portion or the like 
which dose not change meaning or nuance of sentence within "representation 
conversion". By carrying out such a processing, sentence presented to user can be 
sentence relatively close to the input sentence and sentence delivered to translation 
processing can be sentence suitable for translation processing. 

A voice translation apparatus (unit) which translates voice by utilizing natural 
language processing as a second embodiment of this invention will now be described. 

First, the configuration of the voice translation unit will be described. It is to be 
noted that, for simplicity, the same reference numerals are respectively attached to the 
portions common to the above-described translation vmit in the voice translation unit. 

The voice translation unit is composed of, as shown in FIG. 9, display section 
1 for displaying various information, input section 2 for accepting input, representation 
converting section 3 for converting representation of sentence, machine translation 
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section 4 for translating sentence, a voice recognition section 7 for carrying out 
recognition processing of voice, a voice synthesis section 8 for generating synthetic 
voice (sound) and. control section 5 for controlling respective components of this 
voice translation unit. 

The display section 1 is comprised of, e.g., liquid crystal display, etc. The 
display section 1 carries out display of various inforaiation on the basis of command 
of the control section 5. 

The input section 2 is comprised of, e.g., plural button switches or touch panels, 
etc. User utilize this input section to thereby carry out selection from information 
displayed on the display section 1 and/or selection of menu relating to the operation 
of the system, etc.. The input section 2 transmits result of input by user to the control 
section 5. 

The voice recognition section 7 is composed of, e.g., microphone, AD 
converter, arithmetic portion, memory portion, etc. , and serves to input voice that user 
speaks by microphone to carry out AD conversion of inputted voice to digitize it to 
carry out recognition processing. Namely, the voice recognition section 7 recognizes 
the content which user speaks to output recognition result corresponding to the 
generated content to the control section. 

The voice synthesis section 8 is composed of, e.g.,. arithmetic portion, memory 
portion, DA converter, speaker, etc. The voice synthesis sectioon 8 receives, from the 
control section 5, sentence translated at the machine translation section 3 to generate 
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synthetic voice to output it from the speaker. 

An example of appearance of the voice synthetic unit comprises, as shown in 
FIG. 10, on one principal surface of a substantially flat parallelepiped-shaped casing 
20, a substantially rectangular liquid crystal display 21 serving as display section 1, 
various button switches 22 serving as input section 2, a microphone 24 for inputting 
voice to the voice recognition section 7, and a speaker 25 for outputting synthetic 
voice from voice synthesis section 8. 

Subsequently, processing steps in the voice synthesis unit will be described with 
reference to the flowchart shown in FIG. 11. 

As the processing procedure in the voice translation unit, an approach is 
assumed to be employed to input Japanese as original language by voice to translate 
it into English as objective language to output synthetic voice of English. 

At the first step S31, user inputs sentence of the Japanese by voice. At the 
subsequent step S32, recognition processing is carried out at the voice recognition 
section 7. 

At step S3 3, voice recognition result from the voice recognition section 7 is 
converted into another representation of the Japanese at the representation converting 
section 3. Further, at step S34, converted result is displayed on the display section 1. 
Thus, confirmation/selection by user is carried out. At this time, voice recognition 
result itself is not displayed on the display section 1, but another sentence indicating 
the same meaning content or intention is displayed thereon. 
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This processing is processing corresponding to the conversion within the 
original language in the abocve-described translation unit. This voice translation unit 
differs from the translation unit in that while processing is implemented to one input 
sentence in the translation unit, conversion processing is implemented to plural 
candidates obtained as voice recognition result. 

At step S3 5, in the case where re-input is selected as the result of 
confirmation/selection by user at step S34, there results ''YES". The processing 
returns to the step S3 1 . In the case where re-input is not selected, there results "NO". 
Thus, the processing proceeds to step S36. 

At the step S36, with the sentence that user has confirmed being as target 
(objective), machine translation conversion is carried out at the machine translation 
section 4. Thus, sentence of English is outputted. In this example, in the case where 
user selects re-input at this time, voice input is carried out for a second time. Finally, 
at step S37, voice synthesis is carried out at the voice synthesis section 8 on the basis 
of translation result of English outputted from the machine translation section 4. 
Thus, synthetic voice of English is outputted. This processing procedure is thus 
completed. 

In this embodiment, the range is limited to the range where translation accuracy 
of language style handled in machine translation can be ensured. Further, inputs of 
various language styles obtained from voice recognition result are converted into 
representation by the language style within the range. Further, user is caused to 
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conjBrm its content to allow him to confinn that the meaning content and/or intention 
are the same although representation is different in the sentence that user has inputted. 
Thus, such a sentence can be ensured as input. 

In addition^ in accordance with this embodiment, confirmation work of user can 
be one time of confirmation work while maintaining voice translation result of good 
accuracy. 

A more practical example of processing in the voice translation unit will now 
be described with reference to FIG. 12, 

First, conversation (speech or voice) of "Daiei Hakubutsu kan ni ikitai no 
desuga.'' is inputted fi*om user to the voice translation unit. Such input is caused to 
undergo voice recognition processing at the voice recognition section 7. For example, 
the input is outputted in a form of plural sentence candidates having high recognition 
score as recognition result. In more practical sense, with respect to input such as 
kana, etc., three sentence candidates of "Daiei Hakubutsukan ni ikitainodesuga.", 
"Daiei Hakubutsukan ni ittenaitai," and "Daiei Hakubutsukan ni itta no desuga" are 
outputted. 

Then, representation conversion processing is carried out at the representation 
converting section 3 with respect to the voice recognition result thus obtained. In the 
case of this example, since "Daiei Hakubutsukan ni ikitaino desuga" and "Daiei 
hakubutsukan ni ittemitai" are very close to each other in the meaning, the input is 
converted into one representation of "Daiei Hakubutsukan ni ikitai. Further, "Daiei 
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Hakubutsukan ni itta no desuga" is converted into ''Daiei Hakubutsukan ni itta". These 
two sentences are displayed on the hquid crystal display of the display section 1 . 

User selects, at the input section 2, the sentence of "Daiei Hakubutsukan ni 
ikitai" as the sentence close to the meaning content and intention that he has said or 
uttered from the displayed sentences. Then, selected sentence is caused to undergo 
machine translation at the machine translation section 4 to thereby generate English 
sentence of 'T want to go to the British museum," to voice-synthesize it at the voice 
synthesis section 8 to output voice of English. 

It is to be noted that, in this embodiment, processing utilizing score may be 
further added. 

Namely, in the voice recognition processing, in general, in the process for 
carrying out recognition processing by utilizing hnbedded Markov model, etc., scores 
are given to candidates of recognition results to compare these values to thereby output 
most probable candidate as one or plural recognition results. In addition, in the 
representation conversion rule shown in FIG. 5, there is employed a technique to take 
statistic of the number of applications of mle on the basis of corpus data, etc, thereby 
making it possible to give score of application frequency every mle. 

Accordingly, in generating representation conversion result, suitable weighting 
operations are respectively implemented to these two scores to integrate such scores 
to thereby have ability to use them. 

In this embodiment, in the voice translation unit in which voice recognition and 



31 

machine translation are combined, confirmation in the voice recognition is postponed 
to merge or integrate it with confirmation of conversion result of the representation 
conversion processing to reduce the number of confirmation operations. However, this 
invention is not limited to such a combination. 

For example, in the case of combination of kana-kanji conversion and 
information retrieval by natural language, there may be employed such a configuration 
to postpone result of kanji conversion with respect to kana input without confirming 
it to carry out such a representation conversion to directly extract key word from 
several kanji conversion candidates to present its result to user to allow him to carry 
out confirmation/selection. In addition, as processing of the succeeding stage, such 
an approach may be applied to representation support, etc. 

A third embodiment of this invention will now be described. 

In this embodiment, while the above-described translation unit is used, 
representation converting section 3 carries out only simple processing such as 
replacement/simplification of sentence end representation, etc, and machine 
translation section 4 also carries out conversion into another representation within 
original language in addition to conversion fi^om original language to objective 
language. 

While this embodiment does not depend upon the method of translation, 
explanation will be given by the system using bilingual (equivalent) template in the 
following description. In addition, original language is Japanese and objective 
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language is English. 

An example of equivalent or bilingual template is shown in FIG. 13. The 
equivalent or bilingual template also has the portion in which there is described the 
representation changed into another expression by original language which is "change 
of expression within the original language" in addition to the portion of the Japanese 
which is original language and the portion of the objective language obtained by 
translating the first-mentioned portion into English which is objective language. 

In the equivalent or bilingual template, as polysemous change of expression, 
'Thank you" and " suimasen (arigatou )" correspond to "suimasen", "Fm sorry." and 
"suimasen (ayamaru)" correspond to "suimasen", "Excuse me." and suimasen 
(yobikake) correspond to "suimasen". "X use Y." and (no change of expression) 
correspond to "X ga Y o tsukau", "X go by Y" and "X ga Y de iku" correspond to "X 
ga Y o tsukau", and "X consume Y". and "X ga Y o shohi sum" corresponds to "X 
ga Y o tsukau". 

Moreover, in the equivalent or bilingual template of FIG , 13, as shortage 
element supplement, "X use Y." and "watashi wa X o tsukau" correspond to "X o 
tsukau", "X go by Y" and "watashi wa X de iku" correspond to "X o tsukau", and "X 
consume Y." and "wata 

shi wa X o shohisuru" correspond to "X o tsukau". 

Further, in the bilingual template shown in FIG. 13, as compound sentence 
development, "SI, but S2." and "SI, shikashi S2" correspond to "SI, ga, S2", "SI, but 
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S2" and "SI, soshite S2*^ correspond to "SI ga, S2", and "SI, but S2/' and "Slo S2" 
correspond to "SI ga S2'\ 

In the bilingual template of FIG, 13, the Japanese portion and EngHsh portion 
are similar to the example of the above-described bilingual template. 

In this bilingual template, the portion of "change of expression within original 
language" is the portion in which representation having one-to-one correspondence 
with respect to the English portion is written by the Japanese, "Representation having 
one-to-one correspondence" is representation in which polysemy is lost by change of 
expression or comment, etc, in the case where the Japanese portion is polysemous, 
and/or representation obtained by supplementing shortage portion in the case where 
shortage element exists in the Japanese portion, etc. 

For example, in FIG. 13, since "suimasen"ofthe Japanese portion is three kinds 
of polysemy, there exist three kinds of translations into English. In the "change of 
expression within original language", representations having no polysemy respectively 
corresponding thereto are described by Japanese. For example, "suimasen 
(=ayamaru)" is written for "Fm sorry", "suimasen (=arigato) is written for "Thank 
you", and "suimasen (==yobikake) is written for "Excuse me". 

Moreover, in the case of translating, e.g., "X o misete kudasai" of the Japanese 
portion, phrase corresponding to "dareni", i.e., shortage element must be 
supplemented. If "watashi ni" is supplemented so that the English portion is "Please 
show me X.", "X o watashini misete kudasai" is writtenn in the portion of "change of 
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expression within the original language" so that "watashi o" is supplemented. 

When there is subsequently input from user with respect to machine 
translation/change of expression processing, matching is taken between input and the 
Japanese portion of bilingual template. Moreover, change of expression such as 
sentence end representation, etc. can be made with respect to input before matching. 
By doing so, the number of templates can be reduced. As conversion of sentence end 
representation, e.g., conversion of input of" - Shimasu" into " - Sum" is mentioned. 

When matching of the template is taken, translation into English is prepared in 
accordance with the template, and change of expression in Japanese is prepared. In 
the case where input is "koreo o misete kudasai", matching is taken with respect to 
template of FIG. 13, and translation into English and change of expression are 
prepared in accordance with the matchiug of the template. Here, it is assmned that 
translation is made with the intention of "kore o kare ni misete aget kudasai". 

Further, result of change of expression of input "kore o watashi ni misete 
kudasai", result of translation into English "Please show me this." and pair of 
translation into English and change of expression are presented to allow user to 
confirm them. In this case, only result of change of expression can be presented. User 
looks at the change of expression portion to confirm whether or not translation into 
English is correctly carried out. 

By looking at the change of expression, user recognizes that translation that he 
does not intend is made to reject this conversion result. 
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In addition, in the case where input is "tetsudo o tsnkau" as shown in FIG. 15, 
there are three kinds of templates matching with input in the bilingual template of FIG. 
13. With respect to these respective templates, translations into English and changes 
of expression are generated. By presenting them, user is allowed to select optimum 
change of expression/translation into English. 

In more practical sense, result of change of expression "watashi wa tetsudo o 
tsukau" and result of translation into English "I use the train,", result of change of 
expression" watashi wa tesudo de iku" and result of translation into English "I go by 
train.", and result of change of expression "watashi wa densha o shohi sum" and result 
of translation into English "I consume the train." are generated. 

User can select the second result of change of expression "watashi wa tesudo 
de iku" and result of translation into English "I go by train." by the change of 
expression as clue. 

It is to be noted that while, in the template system, restriction by 
meaning/attribute, etc. is provided, thereby making it possible to reducing the number 
of templates to be matched, there are instances where because the restriction is 
insufficient, plural templates may be matched. In this embodiment, even in such a 
case, user can select/confinn suitable translation result. 

Further, this method of "simultaneously carrying out representation conversion 
and machine translation" has the merit that it is easy to take consistency even in the 
case where quantity of data is increased because data for representation conversion 
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and data for machine translation exist at the same portion. 

It is to be noted that this third emboditnent can be realized by implementing the 
following modification to the first embodiment. 

In the representation converting section 3 of the translation unit of the first 
embodiment, N best candidates are generated. At this stage, however, 
selection/confirmation are sent to the translation section 4 without carrying out 
selection/confirmation to postpone confirmation. By doing so, N number of 
candidates consisting of pairs of translation result and representation conversion result 
are generated. User carries out selection/confirmation with respect to these 
candidates. 

A modified example as stated below is further indicated with respect to 
"machine translation carried out simultaneously with representation conversion", and 
explanation will be given. 

When the portion of "change of expression within original language" of the 
conversion/translation template of FIG. 13 is viewed, there exist the portion in which 
expression is changed and the portion in which coroment is merely supplemented. 

When they are separated as shown in FIG. 16 to respectively describe "change 
of expression within the original language" and "comment" into different columns, this 
is advantageous both in processing and in preparation of template. 

Namely, as the merit in processing, when "change of expression" and conunent 
are separated, in the case where comment is merely supplemented without carrying out 
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change of expression, discrimination may be easily made. In the case of only 
supplementing comment, simple processing is only required as compared to the case 
where change of expression is required. 

As merits in preparing template, in the case where comment is only 
supplemented, labor required for description may be reduced. 

Moreover, there are instances where circmnstances in which suitable change of 
expression is not imagined in work, but only comment is attached may take place. 
When change of expression and comment are separated, it is easy to describe only 
comment for the time being in such a case, and to describe exchange of expression at 
the time when user notices later. 

As the merit in expression, since comment and result of change of expression 
are separated, there are instances where coimnent and result of change of expression 
may be generated as the result of conversion within original language. Accordingly, 
it is possible to separately both comment and result of change of expression, whereby 
the degree of freedom of expression is improved. 

As shown in FIG, 16, in the example of the template in which "change of 
expression" and comment are separately described, there exist blanks in the rows of 
"change of expression within the original language" and ''comment". These blanks 
respectively represent that change of expression is not made and that comment is not 
supplemented. 

For example, as compared to FIG. 13 with respect to change of of expression 
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of "suimasen", conversion into "suimasen (=ayamaru)" is made in FIG. 13, but 
comment of "expression at the time of apology" is instead supplemented without 
carrying out conversion in FIG. 16. 

Namely, with respect to "suimasen (=^ayainaru)", suimasen (=arigato)" and 
"suimasen (=yobikake)" which are polysemous change of expression of original 
language "suimasen" in FIG. 13, "representation in apology", "representation in 
thanks" and "representation in calling" respectively correspond to those 
representations as comments in FIG. 16, and the rows of change of expression within 
the original language become blank. 

Changes of expression within the original language in FIG. 1 6 are the same with 
respect to original language "X ga Y o tsukau" and original language "X o tsukau" in 
FIG. 13, but comments rows are blank. 

With respect to "SI. shikashi S2^ "SI. Soshite 82" amd "SL S2c " which are 
compound sentence development of original language "S 1 ga , S2" in FIG. 13, changes 
of expression within the original language in FIG. 16 are the same, but "expression in 
negative conjunction", "expression in affirmative conjmction" and " expression of 
parallel" respectively correspond thereto as the comment. 

In processing within original language, "change of expression" and comment 
are separately generated. Then, at the stage of displaying conversion result/translation 
result, both expressions are displayed. 

An example of output with respect to input is shown in FIG. 17. Since input is 
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"suimasen", it is outputted in the state matched with 1, 2, 3 of the templates of FIG.. 
16, 

Namely, with respect to 1 of FIG. 16, there result change of expression 
"suimasen", comment "representation at the time of apology", and translation into 
Fnglish "Fm sorry". With respect to 2 of FIG. 16, there result change of expression 
"suimasen", comment "representation of thanks" and translation into English "Thank 
you". With respect to 3 of FIG. 16, there result change of expression "suimasen", 
comment " representation in calling" and translation into Enghsh "Excuse me" 

Another example of output with respect to input is shown in FIG. 18. Since 
input " ~ ga, - ", it matches with 1 1, 12, 13 of the templates of FIG. 16. In this case, 
" - " indicates any suitable difference. 

Namely, with respect to 1 1 of FIG. 16, there result change of expression "- o 
shikashi o " comment "expression of negative conjunction" and translation into 
English "- , but ~ ". With respect to 12 of FIG. 16, there result change of expression 
"— o soshite- o comment "expression of affirmative conjunction" and translation 
into English " and ." With respect to 13 of FIG. 16, there result change of 
expression "~ o soshite --o ", comment "expression of parallel" and comment " - o 

^ o 

In this case, " " of translation into English is the portion in which "- " 
indicating the difference is translated into Enghsh. 

While, in these FIGS. 17 and 18, "change of expression" and comment are 
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displayed on separate items, this can be displayed in a maimer of "change of 
expression (comment)" (e.g. excuse me (representation in apology))". 

The reduction of the number of confirmations by execution in advance and 
postponement of confirmation will now be described. 

The technique for reducing the nmnber of confirmations can be applied not only 
to the voice translation apparatus (unit) but also to arbitrary natural language 
processing system having plural processes of "Processing ^ result confiraiation". 

As operation for reducing the number of confirmations, "execution in advance 
of confirmation" and "postponement of confinnation" as described below are defined. 

The execution in advance of confirmation is operation to supplement, before 
first processing P^, second processing P2 for converting input into form which can 
process it with good accuracy at the first processing Pj and second confirmation C2 of 
result of the second processing P2 to thereby omit the first confirmation after the 
first processing Pj. 

The postponement of confirmation is operation to move first confirmation Cj 
immediately after the first processing Pj after the i-th processing Pi of the stage 
subsequent thereto, or the merge (integrate) the j-th confirmation Pj of the subsequent 
stage to thereby reduce the number of confirmations. 

In this example, the confirmation referred to here is an operation such that in 
the case where plural processing results exist, i.e., plural selections exist, user selects 
suitable one therefrom. If selections are not all suitable, user selects "no correct 
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solution". 

In addition, in the case where one processing result exists, the confirmation has 
the meaning that user confirms whether or not one processing result is correct solution. 
Also in the following description, confinnation is assumed to be used in the same 
meaning. 

First, "execution in advance of confirmation" will be described. Execution in 
advance of confinnation is apphed to system having at least one set of processing and 
confirmation. 

For example, in the state before execution in advance of confirmation shown 
in FIG, 19 A is applied, first processing and first confirmation Cj with respect 
thereto are indicated. 

In order to apply execution in advance of confiirmation thereto, as shown in the 
state after application of FIG. 19B is applied, second processing P2 and second 
confinnation C2 for confirming the result are supplemented before the first processing 
Pj to instead delete the first confinnation Cj for confirming result of the first 
processing P^. In this case, box of blank in the figure indicates first confirmation Ci 
thus deleted. 

The second processing P2 is processing for converting input into form which can 
process it with good accuracy at the first processing P^, and its processing content 
depends upon the first processing Pj. 

For example, in the system "before application" of execution in advance of 
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confirmation, since polysemy is included in the input, there are instances where 
confirmation is required after processing (or processing accuracy is lowered). In such 
a case, the second processing P2 required for execution in advance of confinnation 
results in the processing in which input is developed by the number of polysemous 
expressions. 

With respect to processing such as "polysemous expression rule" or "compound 
sentence dissolution rule" shown in FIG. 5, for example, in the second processing P2, 
there is carried out processing to develop input by the number of polysemous 
expressions. 

By this execution in advance, even in the processing in which user is difficult 
to confirm result (e.g., machine translation), it becomes possible to confirm it before 
processing. Thus, confirmation after processing becomes unnecessary. 

"Postponement of confirmation" will now be described. Postponement of 
confoimation is applied to the system having at least two sets of processing and 
confirmations. 

For example, in the state before postponement of confirmation shown in FIG. 
20A is applied, there are indicated first processing Pj and first confinnation C] of the 
preceding stage and second processing P2 and second confirmation C2 of the 
succeeding stage. 

In order to apply postponement of confirmation thereto, as shown in the state 
after applied of FIG. 20B, the first confirmation Cj for confinning result of the first 
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processing Pj of the preceding stage is moved to the portion after the second 
processing of the succeeding stage, or merger (integration) with the second 
confinnation C2 of the processing of the succeeding stage is carried out to allow it to 
be single confirmation. In this example, box of blank in the figure indicates the 
deleted first confirmation Cy. 

In the case where there are plural output results of the first processing Pj, all of 
those results are provided with respect to the second processing P2 and results 
provided from the fixst processing Pj are processed one by one in the second 
processing P^. Further, user confirms its result. 

Combination of execution in advance and postponement of confirmation will 
now be described. Combination of execution in advance and postponement is applied 
to the system having two sets of processing and confirmations of its result. 

For example, in the state before combination of execution in advance and 
postponement of confirmation of FIG. 21 A is not applied, there are indicated first 
processing Pj, first confinnation Cj, second processing P2 and second confiraiation C2. 

When execution in advance is apphed to the second confirmation C2, there 
results a fonn as shown in FIG, 2 IB. Namely, third processing P3 is supplemented 
before the second processing P2 as "processing for converting input into form which 
can process it with good accuracy by the second processing P2", third confirmation C3 
for confirming result of the third processing P3 is also supplemented, and the second 
confirmation C2 is deleted. Box of blank in the figure indicates the deleted second 
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confirmation 

Then, when postponement is applied to the first confirmation in the state 
where execution in advance is applied to the second confirmation C2 shown in FIG. 
2 IB, the first confirmation Cj is merged (integrated) with the third confirmation C3 
after the third processing P3. In this way, the number of confirmations is reduced fi:*om 
two times to one time. Box of blank in the figure indicates position of the moved first 
confirmation Ci. 

Moreover, in this embodiment, since the processing are continuous in a manner 
of "-^ first processing Pj-^ third processing such processing may be replaced by 
processing in which two processing are merged or integrated. 

It may be difficult for user to confinn processing result in dependency upon the 
content of the second processing P2. For this processing, there are instances 
where,e.g., the second processing P2 is translation processing. 

Even if postponement is merely applied to such a system to merge or integrate 
confirmation, since confimation remains to be difficult, integration (merger) is of no 
sense. However, when execution in advance and postponement are combined as in 
this embodiment, since confirmation is made before the second processing P2, 
confirmation is easy. It is meaningful to carry out integration (merger). 

A more practical example in which "execution in advance" and "postponement" 
of confinnation will now be described. 

A conventional voice translation system has a mode as shown in FIG. 22 A. 
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Namely, processing is carried out in order of voice translation Rj, recognition result 
confirmation C4, machine translation T^, and translation result confirmation C5. 

In the conventional voice translation system shown in FIG. 22A, execution in 
advance is applied to "translation result confirmation C^'\ Namely, as shown in FIG. 
22B, as "processing for converting input into form which can process it with good 
accuracy", representation conversion processing T2 and conversion result confimiation 
Cg for confirming its result are supplemented before the machine conversion 
processing and the translation result confirmation C5 is instead deleted. 

Here, when compared to FIG, 2 IB, representation conversion T2 corresponds 
to second processing C2 and conversion result confirmation Cg corresponds to third 
confirmation C3. In addition, box of blank in the figure indicates deleted translation 
result confirmation C5. 

In the state where execution in advance is applied to the recognition result 
confinnation C4 shown in FIG. 22B, postponement is applied to the "recognition result 
confirmation C4 ' as shown in FIG. 22C. Namely, the "recognition result confirmation 
C4" is moved to the portion after "representation conversion T2" to integrate (merge) 
it with "conversion result confirmation C5" to allow it to be single confirmation. This 
corresponds to the second form of the embodiment. 

In this case, box of blank subsequent (succeeding) to voice recognition Rj 
indicates position where the moved recognition result confirmation C4 exists. 

When postponement is further applied thereto, representation conversion and 
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machine translation can be carried out at the same time as shown in FIG. 22D. 
Namely, postponeraent is applied to "recognition result confirmation C4 + conversion 
result confirmation Cg'' shown in FIG. 22C to move it to the portion after machine 
translation processing Tj. Thus, two processing are continuous in a manner of 
"^representation conversion T2-^machine translation T/', such a processing can be 
replaced by the processing where both operations are integrated or merged (processing 
for simultaneously carrying out representation conversion and machine translation). 

Output of the processing of "representation conversion T2 + machine translation 
Tj" includes both conversion result in the original language and translation result into 
objective language. For this reason, it is easy for user to confinn processing result 
unlike confirmation of translation result in the conventional method. 

As described above, in the above-described embodiment, inputted natural 
language is converted into another representation to allow user to carry out 
selection/confinnation thereafter to carry out processing. Further, when there are 
plural natural language processing and confirmations of results, execution in advance 
and postponement of confirmation are carried out to thereby reduce the number of 
confinnations of user. Namely, there is employed such an approach to convert, before 
a certain processing, input into a fonn which can process it with good accuracy by the 
above-mentioned processing to supplement confirmation of its conversion result to 
thereby integrate (merge) execution in advance of confirmation which omits 
confirmation of the processing and confirmation immediately after a certain processing 
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with confinnation of processing for execution in advance of confirmation introduced 
at the stage subsequent or succeeding thereto, thus to cany out postponement of 
confirmation which reduces the number of confirmations. 

As described above, in this invention, such an approach is employed to convert 
input into representation every one of the inputs to present it to user to carry out 
selection/confimiation. Accordingly, there can be provided natural language 
processing in which confinnation operation by user is as minimTma as possible and 
having high accuracy. 

In accordance with this invention, there can be provided such a natural language 
processing apparatus capable of obtaining output resuk guaranteed from a viewpoint 
of accuracy in a form as close as possible to a desired output by confinnation 
operations as lesser as possible. 

In addition, since selection/confinnation of translation word is substantially 
impossible in the conventional translation, if accuracy of the translation unit is not 
caused to be high, i.e., only one correct solution is outputted, translation was not 
practical. On the contrary, since translation is permitted to correspond to 
selection/confinnation of translation result in the translation of this invention, 
translation is practical even if accuracy of translation imit is not so high. 
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Claims 

1 . A natural language processing apparatus comprising 
input means for inputting natural language; 

converting meas for converting the natixral language inputted by the input 
means; 

confirmation means for confirming the natural language converted by the 
converting means; 

processing means for implementing processing to the natural language 
confirmed by the confirmation means; and 

output means for outputting the natural language processed by the processing 
means. 

2. A natural language processing apparatus as set forth in claim 1^ 

wherein the converting means for converting a representation into at least 
another representation within the same language. 

3. A natural language processing apparatus as set forth in claim 1, 
wherein accuracy of processing at the processing means is guaranteed. 

4. A natural language processing apparatus as set forth in claim 2, 
wherein the processing means carries out processing by template. 

5. A natural language processing apparatus as set forth in claim 1, 

wherein first language is inputted to the input means, the processing means 
translates the first language into second language, and the output means outputs the 
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second language translated by the processing means. 

6. A natural language processing apparatus as set forth in claim 5, 

wherein the converting means converts the first language inputted by the input 
means into another representation of the first language. 

7. A natural language processing apparatus as set forth in claim 5, 

wherein the converting means converts the first language inputted by the input 
means into third language. 

8. A natural language processing apparatus as set forth in claim 1, 

wherein the converting means converts plural representations into single 
representation with respect to representation of natural language inputted by the input 
means. 

9. A natural language processing apparatus as set forth in claim 1, 

wherein the converting means converts polysemous representation into plural 
univocal representations with respect to representation of natural language inputted by 
the input means. 

10. A natural language processing apparatus as set forth in claim 1, 

wherein the converting means carries out conversion by at least one of merger 
(integration), division, deletion, replacement and exchange of order with respect to 
representation of natmral language inputted by the input means. 

11. A natural language processing apparatus as set forth in claim 1, 
wherein the input means inputs natural language by voice. 
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12. A natural language processing apparatus as set forth in claim 11, 

wherein the confinnation means confinns, only once, natural language inputted 
by voice to the input means. 

13. A natural language processing apparatus as set forth in clam 1, 
wherein the input means inputs natural language by character. 

14. A natural language processing apparatus as set forth in claim 13, 

wherein the confirmation means confirais, only once, natural language inputted 
by character at the input means. 

15. A natural language processing apparatus as forth in claim 1, 

wherein first language is inputted to the input means, the converting means 
converts first language inputted to the input means into second representation of 
second language and converts it into first representation of the first language having 
one-to-one correspondence with respect to the second representation, and the 
confirmation means carries out confirmation by using the first representation. 

16. A natural language processing apparatus as set forth in claim 15, 

wherein the processing means translates the first language into the second 
language on the basis of conversion at the converting means and confirmation at the 
confinnation means, and the output means outputs the second language translated by 
the processing means. 

17. A natural language processing apparatus comprising 
input means for inputting natural language; 
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one or two processing means or more for implementing processing to the 
natural language; 

one or two confirmation means or more for confirming result of processing with 
respect to the natural language; and 

output means for outputting the processed natural language, 
wherein second processing means for converting natural language inputted to 
the inputting means into form which can process it with good accuracy and second 
confirmation means for confirming result of the second processing means are provided 
at the preceding stage of the first processing means to thereby carry out execution in 
advance of confirmation to omit confirmation of result of the first processing means, 

18. A natural language processing apparatus as set forth in claim 17, 

wherein processing by the fiirst processing means is machine translation 
processing, kana-kanji conversion processing, information retrieval processing by 
natural language, or representation conversion processing by natural language. 

19. A natural language processing apparatus as set forth in claim 17, 

wherein processing by the second processing means is machine translation 
processing, kana-kanji conversion processing, infomation retrieval processing by 
natural language, or representation conversion processing by natural language. 

20. A natural language processing apparatus as set forth in claim 17, 

which includes, at the preceding stage of the second processing means, third 
processing means and third confirmation means for confirming result thereof, whereby 
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the tliird confimiation means is moved to the portion after the second processing 
means or processing means of the stage succeeding thereto, or the third confinnation 
means is merged or integrated into the second confirmation means or confirmation 
means of the stage succeeding thereto to thereby carry out postponement of 
confinnation. 

21, A natural language processing apparatus as set forth in claim 20, 

wherein means in which the second confirmation means and the third 
confirmation means are merged or integrated gives result of processing as nxmieric 
value to present the numeric value. 

22, A natural language processing apparatus as set forth in claim 20, 

wherein the first processing means carries out machine translation and the third 
processing means carries out voice recognition. 

23, A natural language processing apparatus as set forth in claim 20, comprising 
voice recognition processing means for carrying out voice recognition of natural 
language inputted to the iaput means, recognition result confinnation means 
for confirming recognition result at the voice recognition processing means, 
machine translation means for implementing machine translation to the result 
confirmed at the recognition result confimiation means, and translation result 
confirmation means for confirming translation result at the machine translation 
means, 

wherein representation conversion processiag means for converting 
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representation and representation conversion confinning means for confirming result 
of the conversion thereof are supplemented at the preceding stage of the machine 
translation processing means to thereby carry out execution in advance of processing 
by the translation result confirmation means to omit the translation result confirming 
means of the stage succeeding to the machine translation processing means. 

24. A natural language processing apparatus as set forth in claim23, 

wherein postponement of processing by the recognition result confirming means 
which merges or integrates the recognition result confirmation result with the 
representation conversion result confinning means existing at the stage succeeding 
thereto is carried out. 

25. A natural language processing apparatus comprising 
input means for inputting natural language; 

converting means for converting first language inputted to the input means into 
representation having one-to-one correspondence with respect to representation of 
second language by representation by the second language and representation by third 
representation; 

confirmation means for confinning representation of the third language 
converted at the converting means; 

processing means for implementing processing to the natural language inputted 
at the input means in accordance with result of the confinuation at the confirmation 
means; and 
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output means for outputting natural language to which the processing has been 
implemented at the processing means. 

26. A natural language processing apparatus as set forth in claim 25, 

wherein, at the converting means, the second language is language to be 
translated, and representation by the third language is obtained by conversion of 
representation by the first language. 

27. A natural language processing method comprising 
an input step of inputting natural language; 

a conversion step of converting the natural language inputted at the iaput step; 
a confirmation step of confimiing the natural language converted at the 
conversion step; 

a processing step of implementing processing to the natural language confirmed 
at the confirmation step; and 

an output step of outputting the natural language processed at the natural 
language processing step. 

28. A natural language processing method as set forth in claim 27, 

wherein, at the conversion step, a procedure is taken to carry out conversion 
into at least another representation within the same language. 

29. A natural language processing method as set forth in claim 27, 

wherein first language is inputted at the input step; at the conversion step, a 
procedure is taken to convert the first language inputted at the input step into second 
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representation of second language, and to convert it into first representation of the 
first language having one-to-one correspondence with respect to the second 
representation, and at the confirmation step, a procedure is taken to carry out 
confirmation by using the first representation. 

30. A natural language processing method as set forth in claim 29. 

wherein, at the processing step, a procedure is taken to translate the first 
language into the second language on the basis of conversion at the conversion step 
and confirmation at the confirmation step; and at the output step, a procedure is taken 
to output the second language translated at the processing step. 

31. A natural language processing method comprising 
an input step of inputting natural language; 

one, or two processing steps or more of implementing processing to the natural 
language; 

one, or two confinnation steps or more of confirming result of processing with 
respect to the natural language; and 

an output step of outputting the processed natural language; 

wherein a second processing step of converting natural language inputted at the 
input step into form which can process it with high accuracy and a second 
confinnation step of confirming result of the second processing step are provided at 
the preceding stage of the first processing step to thereby carry out execution in 
advance of confirmation to omit confirmation of result of the first processing step. 
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32. A natural language processing method as set forth in claim 31, 

which includes, at the preceding stage of the second processing step, a third 
processing step and a third confirmation step of confirming result thereof, 

wherein the third confirmation step is moved after the second processing step 
or processing step at the stage subsequent thereto, or is merged into the second 
confirmation step at the subsequent stage or confinnation step at the stage of 
subsequent thereto to thereby carry out postponement of confirmation. 

33. A natural language processing method including 
an input step of inputting natural language; 

a conversion step of converting first language inputted at the input step into 
representation having one-to-one correspondence with respect to representation by 
second language by representation by second language and representation by third 
language; 

a confirmation step of confirming representation of the third language 
converted at the conversion step; 

a processing step of implementing processing to the natural language inputted 
at the input means in accordance with result of confirmation at the confirmation step; 
and 

an output step of outputting natural language to which the processing has been 
implemented by the processing means. 



57 

ABSTRACT 

A natural language processing apparatus includes an input section for inputting 
natural language, a representation converting section for converting representation of 
the natural language, a display section for displaying, for confinnation, sentence 
converted at the representation converting section, a machine translation section for 
carrying out machine translation of the confirmed sentence, and a control section for 
controlling these respective sections, thus to provide natural language processing in 
which confirmation operation of user is reduced. 
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DAlEi HAKUBUTSUKANN Nl 
IKITAINODESUGA 
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VOICE RECOGNITION 




t 



USER VOICE 



DAIEI HAKUBUTSUKANN Nl 
IKITAINODESUGA. 
DAIEI HAKUBUTSUKANN Nl ITIEMITAI. 
DAlEi HAKUBUTSUKANN Nl ITTANO 
DESUGA. 







REPRESENTATION CONVERSION 
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f 



RESULT 



DAIEI HAKUBUTSUKANN Nl IKITAI. 
DAIEI HAKUBUTSUKANN Nl ITTA. 





■ REPRESENTATION 

CONVERSION RESULT 


CONFIRMATION/SELECTION BY USER 
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RESULT 
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ORIGINAL 
LANGUAGE 



OBJECTIVE 
LANGUAGE 



CHANGE OF 
EXPRESSION WITHIN 
ORIGINAL LANGUAGE 



[CHANGE OF EXPRESSION 
FOR POLYSEMOUS WORD] 

1. SUIMASEN 

2. SUIMASEN 

3. SUIMASEN 

4. X GA Y O TSUKAU 

5. X GA Y O TSUKAU 

6. X GA Y O TSUKAU 

[SHORTAGE ELEMENT 
SUPPLEMENT] 

7. X O TSUKAU 

8. X O TSUKAU 

9. X O TSUKAU 

10. X O MISETE KUDASAI 

[COMPOUND SENTENCE 
DEVELOPMENT] 

11. S1GA,S2 

12. S1GA,S2 

13. S1 GA, S2 



I'M SORRY. 
THANK YOU. 
EXCUSE ME. 

X USE Y. 
X GO BY Y. 
X CONSUME Y. 



I USE Y. 
I GO BY Y. 
I CONSUME Y. 

PLEASE SHOW ME X. 



SI, BUT S2. 
S1, AND S2. 
S1, S2. 



SUIMASEN (=AYAMARU) 
SUIMASEN (=ARIGATO) 
SUIMASEN (=YOBIKAKE) 

(NO CHANGE OF EXPRESSION) 

X GA Y DE IKU. 

XGA Y O SHOHI SURU. 



WATASHI WA X O TSUKAU. 

WATASHI WA X DE IKU. 
WATASHI WA X O SHOHI SURU 

X O WATASHI Nl 
MISETE KUDASAI 

S1,SHIKASI S2. 
S1, SOSHITE S2. 
S1, S2. 
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INPUT : "KOREO MISETE KUDASAI" 



(SAID WITH THE INTENTION THAT 
"kORE O MISETE AGETE KUDASAI") 



OUTPUT : (RESULT OF CHANGE 
OF EXPRESSION) 

(RESULT OF TRANSLATION 
INTO ENGLISH) 



KOREO WATASHI Nl 
MISETE KUDASAI 

PLEASE SHOE ME THIS. 



, BY LOOKING AT "RESULT OF CHANGE OF EXPRESSION- 
USER UNDERSTANDS THAT TRANSLATION DIFFERENT 
FROM HIS INTENTION IS CARRIED OUT 
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INPUT : "TETSU DO O TSUKAI MASU " 






SIMPLE SENTENCE END 
, REPRESENTATION CONVERSION 




"TETSU DO O TSUKAU" 




OUTPUT : 


(RESULT 1 OF CHANGE 
OF EXPRESSION) 


WATASHI WA 
TETSUDO O TSUKAU. 




(RESULT 1 OF TRANSLATION 
INTO ENGLISH) 


1 USE THE TRAIN. 




(RESULT 2 OF CHANGE 
OF EXPRESSION) 


WATASHI WA 
TETSUDO DE IKU. 




(RESULT 2 OF TRANSLATION 
INTO ENGLISH) 


1 GO BY TRAIN. 




(RESULT 3 OF CHANGE 
OF EXPRESSION) 


WATASHI WA DENSHA 
O SHOHI SURU. 




(RESULT 3 OF TRANSLATION , 
INTO ENGLISH) ' 


CONSUME THE TRAIN. 




....USER CAN SELECT SECOND SENTENCE BY 
RESULT OF CHANGE OF EXPRESSION AS CLUE 
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INPUT : "SUIMASEN" 




1) 


(CHANGE OF 
EXPRESSION) 

(COMMENT) 

(TRANSLATION 
INTO ENGLISH) 


SUIMASEN 

REPRESENTATION AT THE 
TIME OF APOLOGY 

I'M SORRY. 


2) 


(CHANGE OF 
EXPRESSION) 

(COMMENT) 


SUIMASEN 

REPRESENTATION OF THANKS 




(TRANSLATION 
INTO ENGLISH) 


THANK YOU. 


3) 


(CHANGE OF 
EXPRESSION) 

(COMMENT) 


SUIMASEN 

REPRESENTATION OF CALLING 




(TRANSLATION 
INTO ENGLISH) 


EXCUSE ME. 
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INPUT : "~GA, ~ " 




1) 


(CHANGE OF 
EXPRESSION) 


~o SHIKASHI ~o 




(COMMENT) 


EXPRESSION OF 
NEGATIVE CONJUNCTION 




(TRANSLATION 
INTO ENGLISH) 


~, BUT ~. 


2) 


(CHANGE OF 
EXPRESSION) 


~o SOSHITE ~o 




(COMMENT) 


EXPRESSION OF 
AFFIRMATIVE CONJUNCTION 




(TRANSLATION 
INTO ENGLISH) 


~, AND ~. 


3) 


(CHANGE OF 
EXPRESSION) 


o o 




(COMMENT) 


EXPRESSION OF PARALLEL 




(TRANSLATION 
INTO ENGLISH) 


5 " 
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PROCESSING Pi 






CONFIRMATION Ci 
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FIG. 
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PROCESSING P2 
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PROCESSING P1 
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PROCESSING P1 






CONFIRMATION Ci 
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PROCESSING P2 






CONFIRMATION C2 
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FIG.20A 
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PROCESSING P1 
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PROCESSING P2 






CONFIRMATION Ci + 
CONFIRMATION C2 
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PROCESSING P1 



CONFIRMATION Ci 



PROCESSING P2 



CONFIRMATION C2 



PROCESSING P1 



CONFIRMATION Ci 



PROCESSING P3 



CONFIRMATION C3 



PROCESSING P2 



FIG.21A 



FIG.21B 



PROCESSING Pi 
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PROCESSING P3 



CONFIRMATION Ci + 
CONFIRMATION C3 



PROCESSING P2 
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VOICE RECOGNITION Ri 



RECOGNITION RESULT 
CONFIRMATION C2 



MACHINE 
TRANSLATION Tl 



TRANSLATION RESULT 
CONFIRMATION C5 



VOICE RECOGNITION Ri 



RECOGNITION RESULT 
CONFIRMATION C4 



REPRESENTATION 
CONVERSION T4 



TRANSLATION RESULT 
CONFIRMATION Ce 



MACHINE 
TRANSLATION Ti 



FIG.22A 
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VOICE RECOGNITION Ri 



REPRESENTATION 
CONVERSION T2 



RECOGNITION RESULT 
CONFIRMATION C4 + 

CONVERSION RESULT 
CONFIRMATION Ce 



MACHINE 
TRANSLATION Ti 



FIG.22B 



VOICE RECOGNITION Ri 



REPRESENTATION 
CONVERSION T2 + 

MACHINE 
TRANSLATION Ti 



RESULT CONFIRMATION 
C4 + C6 



FIG.22C 
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